Tags → #data engineering
-
Listing partitions of a table in BigQuery
How to get list of all table's partition without querying the table directly.
-
DBT: Ensure that environment variable is set during dbt run.
DBT: Ensure that environment variable is set during dbt run (but does not raise an error if variable is not set during dbt compile).
-
Open-sourcing JustJoinIT job board dataset (2021-2023)
How I collected & open-sourced data from JustJoinIT job board (one of the biggest IT job boards in Poland).
-
Airbyte’s column selection is finally here
Testing Airbyte's new feature (column selection) - how does it behave when used with CDC synchronization?
-
Airbyte DBT normalization project without running a sync
How to generate Airbyte DBT default normalization boilerplate code (DBT project) without running a sync.